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Abstract 

This paper investigates tail-biting trellis realizations for linear block codes. Intrinsic trellis 
properties are used to characterize irreducibility on given intervals of the time axis. It proves 
beneficial to always consider the trellis and its dual simultaneously. A major role is played by 
trellis properties that amount to observability and controllability for fragments of the trellis of 
various lengths. For fragments of length less than the minimum span length of the code it is 
shown that fragment observability and fragment controllability are equivalent to irreducibility. 
For reducible trellises, a constructive reduction procedure is presented. The considerations also 
lead to a characterization for when the dual of a trellis allows a product factorization into 
elementary ("atomic") trellises. 

1 Introduction 

The powerful performance of iterative decoding algorithms for codes on graphs has made graphical 
models a major topic in coding theory. In particular, it has led to a vivid interest in optimal 
graphical representations of (linear) block codes. For cycle-free graphs, this realization theory is by 
now well understood. In this case, a realization is minimal if and only if it is trim and proper (i.e., 
every state occurs in some constraint codeword and no constraint codeword is supported by a single 
state variable), and minimal realizations are unique up to state space isomorphisms. Moreover, 
every non-minimal realization can be reduced to a minimal one by a process of trimming and 
merging. For details on all of this, see Olini) as well as the excellent survey [19j for the special case 
of conventional trellis realizations. 

The focus of this paper is on linear tail-biting trellises, which form the simplest type of real- 
izations on graphs with cycles. Tail-biting trellises gained a lot of attention after the appearance 
of [2], where it was shown that, for a given code, the complexity of a tail-biting trellis realization 
may be considerably lower than that of the best conventional (i.e., cycle-free) trellis. This resulted 
in increased study of (minimal) tail-biting trellises [l5l [lU [HI [lU [171 [Qj [HI [3] as well as for normal 
realization on general graphs [U [TU UHl [I] ■ 

A systematic theory of tail-biting trellis realizations was initiated by Koetter/Vardy in their 
landmark paper [13] . Among other things, they highlighted the fundamental problem that all 
meaningful concepts of complexity measures for tail-biting trellises lead to different (pre-)orderings, 
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all of which are only partial. As a consequence, a given code does not have a unique minimal trellis 
realization. By extending factorization ideas from conventional trellises, Koetter /Vardy showed 
in [12] that every reduced trellis (i.e., all states and branches appear on valid trajectories) is a 
product trellis, that is, it can can be obtained as the product of elementary trellises. In |13j . they 
showed that product trellises based on "shortest generators" of the code in a circular interval sense, 
form a reasonably small class of trellises which is guaranteed to contain all minimal trellises. 

In [9l |8j it is shown that these trellises, called KV-trellises, enjoy nice properties; for instance, 
they are non-mergeable, and the dual of a KV-trellis (in the sense of normal realization dualiza- 
tion is a KV-trellis. As a consequence, the dual of a KV-trellis is a product trellis representing 
the dual code. The last property is remarkable because in general the dual of a product trellis 
(even if non-mergeable) is not a product trellis. Yet, this invariance under dualization does not 
characterize KV-trellises, and in fact, no intrinsic characterizations for being a KV-trellis or being 
minimal are known. As a consequence, no constructive method for reducing a given realization to 
a minimal one has been found yet. 

In this paper, we study tail-biting trellises, and make some progress on these aforementioned 
topics. We derive constructive procedures to reduce the complexity of a trellis, and derive irre- 
ducibility criteria. 

We began our investigation of irreducibility in [7] , where we considered normal realizations on 
general graphs. In that paper, a local reduction was defined as the replacement of one state space 
by a smaller one, and an adjustment of the adjacent constraint codes, without changing the rest of 
the realization or the code that is realized. We showed that a realization that is not trim, proper, 
observable and controllable (TPOC) may be locally reduced by a trimming or merging operation 
on an appropriate state space. We note that in the prior literature, starting with [20J, merging has 
been studied much more than trimming, no doubt because it seems obvious to trim unused states; 
however, because trimming and merging are dual operations we weight them equally. 

This paper continues our investigation for the special case of linear tail-biting trellises. In this 
case, the reductions considered in [Tj may be regarded as reductions of trellis fragments of length 2 
(two consecutive constraint codes and the state space involved in both of them), and it appears 
natural to extend such reductions to fragments of any length. As we will see, reducibility is then 
closely related to properties of the dual trellis realization. Indeed, if the given trellis or its dual 
lacks certain basic, easily detectable properties, then both can be reduced simultaneously. In this 
sense, the dual trellis may reveal defects that are not immediately apparent in the primal trellis. It 
is therefore natural to treat a trellis and its dual on an equal footing, so that all reductions come 
with an analogue for the dual trellis. 

In this fashion we can show that the necessary properties for irreducibility on fragments of 
length 2, presented in [7], extend to necessary conditions for irreducibility on longer fragments. They 
amount to fragment observability and controllability, and are closely related to trimness of the trellis 
and its dual in a fragment sense. We also prove that these conditions are sufficient for irreducibility 
on fragments of length less than the minimum span length of the code, which is a measure of the 
lengths of zero runs in the codewords. We then discuss the remaining case of reducibility on longer 
fragments, and illustrate with an example how this problem may be approached; however, this case 
remains largely open. 

Finally, we relate our results to the approach taken by Koetter and Vardy in |12| I13j . As 
mentioned earlier, they investigated the class of reduced trellises and narrowed it further down 
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to KV-trellises in their search for minimal trehises. In this paper, we do not assume reducedness 
because the dual of a reduced trellis is not necessarily reduced. In fact, our results will indeed 
provide an easy-to-check criterion for when the dual of an observable reduced trellis is a reduced 
trellis. We also present a summary of various trellis classes and their relationship. 

2 Codes, Trellises, and Reducibility 

In this section we introduce the basic notions for trellises as needed in this paper. Most of it is 
simply a specialization of the terminology used in [7] for general normal realizations. In addition, 
we also define local reductions of trellises; this will be more refined than the definition used in [7j. 

Throughout, a linear block code C over a finite field F is a subspace of a symbol configuration 
space A = n™Q Ai, where each symbol alphabet Ai is a finite-dimensional vector space over F. 

A linear tail-biting trellis realization TZ of length m is a normal linear realization, in the sense 
of [1] or [7], on a graph that is a single cycle of length m. Thus, it consists of a set of symbol 
spaces Ai, a set of state spaces Si, and a set of constraint codes Ci Si x Ai x where all index 
sets are equal to and index arithmetic is modulo m. Every constraint code thus involves precisely 
two state variables. All variable alphabets are finite-dimensional vector spaces over F. The elements 
of Cj (called constraint codewords, or transitions, or branches) will be written as (sj, Oj, Sj+i). 

As noted in [7|, if any state space Si is trivial, then we may simply delete it. The graph of TZ 
then becomes a finite path, and the realization becomes a conventional linear trellis realization of 
length m. Thus finite conventional trellis realizations may be regarded as special cases of tail-biting 
trellis realizations. 

Henceforth, we will call a linear tail-biting trellis realization simply a trellis. 

The space S = Ili^o^ called the state configuration space of TZ. The behavior is the 
set *B of all trajectories (or configurations) (a, s) £ AxS such that all constraints are satisfied, i.e., 
(sj, Qi, Sj+i) G Ci for all i G Z^. The pairs (a, s) G *B are called valid trajectories (or configurations). 
The code C generated by the trellis is the set of all symbol trajectories a G ^ that appear in some 
(a, s) G 5S. A code generated by a linear trellis is linear. 

The dual trellis of a trellis TZ, denoted by TZ°, is defined as the trellis with the same index set in 
which the symbol and state spaces Ai and Si are replaced by their linear algebra duals Ai , Si (which 
are unique up to isomorphism), the constraint codes Ci are replaced by their orthogonal codes C^' 
under the standard inner product, and the sign of each dual state variable is inverted in one of 
the two constraints in which it is involved. For trellises it is convenient to apply the sign inversion 
to Sj+i; thus a dual trajectory (a, s) is valid if and only if {si,ai, — Sj+i) G C^- for all i G Z^. The 
behavior 53° of TZ° is the space of all such valid dual trajectories. The Normal Realization Duality 
Theorem [4J states that if TZ realizes the code C, then its dual TZ° realizes the orthogonal code C"*". 
For other proofs see [HI [U [5l [7] . 

Trellises TZ and TZ of length m with state spaces and constraint codes Si, Ci, Si, Ci are called iso- 
morphic if there exist state-space isomorphisms ipi : Si ^ Si such that Ci = {((^j(sj), Oj, (/9j+i(sj+i)) | 
(sj,ai,Sj+i) G Cjjj^ Evidently, isomorphic trellises realize the same code. Following [TSj Def. 3.1], 
we say a trellis TZ is smaller than TZ if their state spaces satisfy dim5j < dim5j for all i, and we 

^It is interesting to note that for connected trellises this definition may be relaxed to requiring that the maps Lpi only 
be bijections rather than isomorphisms. Indeed, Conti proved recently [3j Thm. 3.28, Cor. 6.6] that the isomorphism 
classes of connected trellises coincide for these two notions. 
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call TZ strictly smaller than TZ if we have at least one strict inequality. A trellis is called minimal if 
there is no strictly smaller trellis realizing the same code. 

In [71 Thm. 3] it has been shown that realizations on cycle-free graphs are minimal if and 
only if they are trim and proper (see the next section for the definitions), and that a nonminimal 
realization can be reduced in a constructive way. It is well known that trimness and properness are 
not sufficient for minimality of realizations on graphs with cycles. The goal of this paper is to study 
the particular case of single-cycle graphs, develop constructive methods of reducing the complexity 



of a given realization on such a graph, and present irreducibility criteria. Definition 2.1 below will 
be the central concept of this paper. 

A major part of our approach will be the analysis of trellis fragments. We use the following 
notation. For j, k E Zm and j ^ k let [j, k) := {j, j + 1, . . . , /c — 1} C denote a (possibly circular) 
subinterval of Z^; thus is the disjoint union of the two complementary subintervals [j, h) and 
\k,j). Correspondingly, a trellis TZ of length m may be divided into two cycle-free complementary 
fragments, denoted by T^b''^) and 1Z^^'^\ by cutting the edges associated with states Sj and Sk- The 
fragment TZ^''^^ includes all symbol spaces and constraint codes with indices in [j,k), and TZ^^'^^ 
includes all with indices in [k,j). The fragment TZ^^'^^ also contains the state spaces Si with indices 
in (j, k) as internal state spaces, and similarly T^t*^'-?) contains the internal state spaces Si with 
i € {k,j). The two boundary state spaces Sj and Sk may be regarded as external state spaces in 
both fragments. Note that the internal state spaces have degree 2 and correspond to normal edges, 
whereas the external state spaces have degree 1 and correspond to half-edges, like symbol spaces. 

We extend this notation by defining [j, j + m) to be the entire time axis "starting at j" , 
and the complementary interval [j + m, j) to be the empty interval "starting at j". Then 7^y+'"'-5') 
denotes the cycle-free fragment consisting of all of TZ except for the edge Sj, while 7^ [■5'+™'-?) denotes 
the complementary fragment consisting only of the edge Sj. Both fragments have two external state 
variables with common alphabet Sj, as we will discuss further in Section [5] 

Definition 2.1 Let [j,k) be a non-empty interval. A [j,k)- reduction TZ of a trellis 7^ is a replace- 
ment of the state spaces Sj+i,Sj+2, ■ ■ ■ ,Sk-i by state spaces Sj-\-i,Sj+2, ■ ■ ■ ,Sk~i of at most the 
same size and the adjacent constraint codes Cj, . . . ,Ck-i by suitable constraint codes Cj,. . . ,Ck-i 
of any size, without changing the rest of the realization or the code C that it realizes. We also call 
this a t-reduction, where t = {k — j) mod m G {1, . . . , m}. The reduction will be called strict if at 
least one of the state space sizes decreases strictly, and conservative if none of the constraint code 
sizes increases. A trellis TZ is called t-irreducible if each t-reduction is isomorphic to TZ. 

Note that a [j, fc)-reduction affects the constraint codes and the internal state spaces in the 
fragment TZ^^'^\ but not its external state spaces Sj and Sk- Thus a t-reduction affects t constraint 
codes and t — 1 state spaces. An m-reduction affects all constraint codes, and all but one state 
space. 

If a trellis TZ is (strictly) t-reducible, then it is (strictly) t'-reducible for all t' > t. Furthermore, 
it is immediate from the dualization of trellis realizations, that a trellis TZ is (strictly) t-reducible if 
and only if the dual trellis TZ° is (strictly) t-reducible. 

We note in passing that a minimal trellis may have a conservative t-reduction for some t > 1. 
This is due to the fact that a code may have non-isomorphic minimal trellises with the same state 
space and constraint code dimensions |i9i Ex. III. 16]. However, we will see later that minimal trellises 
are always 1-irreducible, which is to say that no single constraint code can be replaced by any other 
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constraint code without changing the code reahzed by the trelhs. 

The primary goal of our reduction procedures wih be the reduction of state spaces, but we will 
also address the constraint code dimensions. While state space dimensions do not change under 
dualization, this is not the case for the constraint code dimensions. This causes the constraint code 
dimensions to be less predictable in general. 

It will become clear later that non-strict t-reductions form indeed a useful concept — even 
though they may not immediately lead to a net decrease of the state space sizes and may even 
increase the constraint code sizes. Non-strict reductions will be used to produce strictly reducible 
trellises so that ultimately a net reduction in state space sizes is achieved. A particular instance of 
a non-strict reduction is a 1-reduction that consists of the replacement of a single constraint code 
(by one that may be bigger or smaller), and thus does not alter the state complexity profile of the 
realization. 

The most important instances of strict and conservative 2-reductions are the mutually dual 
processes of trimming and merging. We briefly recall these concepts. Let TZhe a trellis with state 
spaces Si and constraint codes Cj. Fix j € and let yj be a subspace of Sj. We say that TZ 
is trimmed to yj if we restrict the state space Sj to yj and restrict the two adjacent constraint 
codes Cj-i and Cj accordingly. We say that TZ is merged to the quotient space Sj/yj if we replace 
the state space Sj by the quotient space Sj/yj and replace the states at time j in the two adjacent 
constraint codes Cj_i and Cj by their cosets modulo yj. Projection/cross-section duality (given 
in (2.1) below) implies that the trellis TZ' is obtained from TZ by trimming Sj to the subspace yj 
if and only if {TZ')° is obtained from TZ° by merging Sj to Sj/y-^ . For a proof, further details and 
a graphical illustration of the duality of trimming and merging see [3 Sec. III.B]. In general, the 
trimmed/merged realization generates a different code than the original realization. We will, of 
course, be interested in the case where the code does not change after trimming/merging. In this 
case, trimming and merging obviously form simultaneous strict and conservative 2-reductions of the 
trellis and its dual. For the notions of non-mergeability and non-trimmability, see the next section. 

We close this section by briefly recalling the projection/cross-section duality theorem. This 
identity is one of the most fundamental and useful duality relationships for linear codes and will be 
used frequently throughout this paper. Let C be a subspace contained in a vector space T = 7i x Ti- 
The projection and cross-section of C on 7i are deflned as C\j-^ := {^i | 3 ^2 £ Ti : (^1,^2) G C} 
and C-qi := {ti \ (ti,0) G C}, respectively. Suppose we have inner products between Ti and Ti for 
each i which we extend in the natural way to 7i x Ti and its dual 7i x Ti. Projection/cross-section 
duality [1] (see also O Sec. II. H]) states that 

{C:%)^ = {C^)lf. (2-1) 

for any subspace C C 71 x Ti and its orthogonal subspace C"*- C Ti x Ti. 



3 Local and Global Trellis Properties 

We recall some basic properties of trellises as they have been discussed in detail in [7] for general 
normal graphs, and discuss some subtleties related to these notions. 

We begin with local trellis properties. A trellis is called trim at state space Si if (Ci-i)^^. = 
= (Ci)|5i) proper at state space Si if the cross-sections (Cj_i):5- and {Ci)-s. are both trivial. 
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The former means that each state in Si has an incoming branch and an outgoing branch while the 
latter means that there are no nontrivial branches of the form (0, 0, Sj) in Ci-i and none of the form 
{si, 0,0) in d. As in [7] we call a trellis trim (resp. proper) if it is trim (resp. proper) at each state 
space. (In the prior literature, e.g. and [T9], "proper" is often called "biproper".) 



Using projection/cross-section duality (2.1) one obtains immediately the following 



Theorem 3.1 ((S], |T|) Let j E {i — 1, i}. The projection of Cj on Si is surjective if and only if the 
cross-section of Cj~ on Si is trivial. Thus, IZ is trim at Si if and only if 1Z° is proper at Si . 

Let us now turn to global trellis properties. A trellis is said to be state-trim if each state appears 
on a valid trajectory, i.e., ^\s- = Si for all i. It is clear that a state-trim trellis is trim. We call 
a trellis branch-trim if each branch appears on a valid trajectory, i.e., ^\SixAixSi+i — ^• 
It is well known that a state-trim trellis need not be branch-trim; see, e.g.. Fig. ^b). In [13J, a 
trellis that is both state-trim and branch-trim is called reduced, and all linear trellises are assumed 
to be reduced. We do not adopt this stance here since the dual of a reduced trellis is not necessarily 
reduced (see, for example. Fig. [T|. 

If a trellis or its dual is not branch-trim, then both are 1-reducible, since in this case there 
exists a 1-reduction that is not isomorphic to the given trellis. The converse will be discussed in 
Theorem 17.11 

We define a trellis to be nonmergeable (in the linear sense) if no state space can be merged to 
a proper quotient space without changing the code generated by the trellis. This is the only kind 
of merging that preserves linearity of the trellis. Our notion of non-mergeability differs from the 
definition in [13], which simply requires that no two states can be merged without changing the 
code. For example, the non-state-trim trellis of Fig. ^h) below is nonmergeable in our sense, but 
is mergeable in the sense of [13|, since states 00 and 11 in 52 can be merged to produce a smaller 
nonlinear trellis that realizes the same code. However, it is easy to show that for state-trim trellises 
this situation cannot arise (since whenever s, s' E Si can be merged, then Si can be merged to the 
quotient space Si/{s — s') without changing the code); see also [3l Observ. 2.8], where "state-trim" 
is called "almost reduced". 

Dually, a trellis is called non-trimmable if it does not allow a proper trimming (in the sense of 
resulting in a trellis for the same code. Duality of trimming and merging, as described in 
implies that a trellis TZ is non- mergeable if and only if its dual TZ° is non-trimmable. It 
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is worth noting that a state-trim trellis may be trimmable. This will be addressed in Theorem 4.4 

A trellis TZ that realizes a code C is called observable (or one-to-one) if for each a E C there is 
precisely one valid trajectory (a, s) E 5S. The trellis is called controllable if its dual TZ° is observable. 
These definitions are discussed in [TJ Sec. IV-C], where it is shown that controllability in this sense 
is equivalent to having independent constraints. 

We will use the following controllability test from [71 Thm. 6]. 

Theorem 3.2 For every trellis TZ we have ^^dimCj < dim*B + ^^dimSi, with equality if and 
only if TZ is controllable. 



In other words. Theorem 3.2 says that the total constraint dimension ^^dimCj is maximized 
if and only if the trellis is controllable. 

As noted in [7^, Footnote 4], this theorem is related to Theorem 4.6 of |13] as follows. Koetter 
and Vardy show that if a reduced (i.e., state-trim and branch-trim) product trellis is observable (so 
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dim 53 = dimC), and no generator has a degenerate span equal to the entire time axis Z^, then (in 
our notation) dimCj = dim 55 + ^- dim5j, so the reahzation is controUable (in our terminology). 

A key property of an uncontrollable trellis TZ is that, under weak conditions, its valid trajectories 
partition into disconnected cosets (for examples, see Figs. [2]^b) and Qb)). In Appendix [A| we 
show that this property holds provided that TZ is state-trim, which is a weaker condition than the 
"reduced" condition of [l3]. Moreover, we give examples showing that state-trimness is indeed a 
necessary condition. 



4 Basic Results about Irreducibility and Motivating Examples 

We start by presenting a list of necessary conditions for 2-irreducibility that has been derived in [7]. 
The rest of the section is devoted to examples illustrating that these properties are not sufficient 
and that the dual of a trellis may be helpful in revealing the reducibility of both the trellis and its 
dual. 

Recall that a (strict) 2-reduction consists of reducing one state space and altering the two 
adjacent constraint codes. Obviously trimming and merging are 2-reductions. 

Theorem 4.1 ([7, Thm. 2, Thm. 9]) A 2-irreducible realization TZ must he trim, proper, ob- 
servable, and controllable, else there exists a strict and conservative 2-reduction of TZ, whose dual 
is a strict and conservative 2-reduction of TZ° . 



In view of Theorem 4.1 we will abbreviate "trim, proper, observable and controllable" by TPOC. 



The following fact has been mentioned already in |11|, Sec. 4]. 

Remark 4.2 Each 2-irreducible realization must be state-trim and nonmergeable, else there exists 
a 2-reduction in form of a state-trimming or state-merging. 

Since 2-reductions of unobservable trellises will be crucial later, we present the process for 
further reference in the next remark. 

Remark 4.3 In the proof of [7, Thm. 9] it has been shown that whenever a trellis TZ contains a 
nontrivial unobservable valid trajectory (0,s), one may pick any of its nonzero states, say Si £ Si, 
and trim the state space Si to any subspace 71 satisfying 71® (si) = Si. This results in a trellis 
realization of the same code (which may be not trim at time i — 1 or i -|- 1, in which case it can be 
further reduced). Being a trimming, this process forms a strict and conservative 2-reduction, and the 
dual merging process is a strict and conservative 2-reduction of TZ° . More precisely, in the trimming 
of TZ the branches (si_i,0, Sj) and (si,0,Si+i) in the constraint codes Ci-i and d are deleted, and 
thus the dimensions of these constraint codes decrease by 1. On the other hand, the constraint code 
dimensions of the dual merging stay the same, since dimC^ = dim. Si + dim5j+i -|- dim^j — dimCj. 

The following theorem is essentially due to Koetter |1H Thm. 9]. For the second statement 
recall that non-mergeability is defined in the linear sense (see Section [3]) and is thus dual to non- 
trimmability. 

Theorem 4.4 A trellis is non-trimmable if and only if it is observable and state-trim. Dually, a 
trellis TZ is nonmergeable if and only if the dual trellis TZ° is observable and state-trim. 
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Proof: As we have just seen, an unobservable trellis is trimmable. As noted by Koetter ^lll Sec. 4], 
an observable trellis is trimmable if and only if it is not state-trim. The last part follows from the 
duality of state- merging and state-trimming discussed in Section [2} □ 

In order to derive further necessary conditions for strict irreducibility, we present two examples 
of mutually dual trellises. Both illustrate that the dual may reveal some shortcomings of the trellis 
and its dual that are not directly discernible from the primal trellis (an observation that has been 
made already by Koetter in [TT]), and which cause the trellis and its dual to be strictly reducible. 
Motivated by these phenomena, we will study strict reducibility simultaneously for a trellis and its 
dual. 

We assume that the reader is familiar with product trellises [12], [131 Sec. IV.C], [HI Sec. III]. 
Every "reduced" (i.e., state-trim and branch-trim) trellis is a product trellis in the sense that its 
behavior *B has a basis consisting of dim 55 one-dimensional "atomic" sub-behaviors, each charac- 
terized by a codeword and its (possibly circular) span. 

Example 4.5 We present a trellis that is TPOC, and yet strictly 2-reducible. This shows that 
Theorem |4.1| provides necessary but not sufficient conditions for 2-irreducibility. We will see that 
the dual trellis, which is also TPOC, is not state-trim, and thus the primal trellis is mergeable due 



to Theorem 4.4 As a consequence, both trellises are strictly 2-reducible. It will become clear that 
the non-state-trimness of the dual trellis is easy to detect, whereas the mergeability of the primal 
trellis is much less obvious. 

Fig. ^a) shows a trellis realization of the code C = {000, 110, 101, 011} C F|j^ The symbol 
spaces are Ai = ¥2 for i £ Z3. The realization is the product trellis obtained from the generators 
101, 1 10 with the indicated circular spans. The trellis appeared first in jl3l Fig. 5], and it has been 
used subsequently for various purposes in [T71 Ex. 1], ^ Ex. IV.8], and |[3i Sec. 7.2]; however, its 
dual (Fig. [T]^b)) has not been discussed in any of these papers. 



(a) (b) 

Figure 1: TPOC, state-trim and branch-trim trellis and its non-state-trim dual 

Fig. [l|b) shows the dual trellis, which generates the dual code = {000, 111}. For the dualization 
we choose Si = Si and the standard inner product for all dual state spaces; no sign inverter is 
needed. Both trellises are TPOC. The trellis in (a) is state-trim, whereas the dual trellis in (b) is 
not state-trim: the states 10 and 01 at time 2 are not on any valid trajectory of this realization. 



Thus by Remark 4.2 both trellises are strictly 2-reducible, and in particular, the trellis in (a) is 



mergeable due to Theorem 4.4 Trimming the dual trellis to the state space {00, 11} at time 2 and 



Trellis Illustration Conventions. Throughout the paper, we will use the following conventions for drawing 
trellises: dashed (resp. solid) lines denote branches with symbol variable (resp. 1). Most of the time, especially for 
dual pairs of trellises, a choice of state labels will be shown as well. It should be kept in mind that the state labeling 
does not play any particular role and may be changed at each index using a state space isomorphism. The states 
in So will always appear in the same ordering at the beginning and end of the trellis. 
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dually merging the primal trellis leads to the pair of mutually dual trellises shown in Figure [2} They 
form [1, 0)-reductions of the trellises in Fig. [T] 




Figure 2: State- merged trellis and state-trimmed dual trellis 

The trellises in Fig. and[2]^b) are standard small examples of unobservable and uncontrol- 
lable trellises, respectively. As discussed in Remark |4.3[ both can be further reduced; the reduced 
trellises in this case are conventional, trim and proper, and therefore minimal. □ 



Example 4.6 We present a trellis that is TPOC, state-trim, branch-trim, nonmergeable, and yet 
strictly 2-reducible. The dual trellis is also TPOC, state-trim, and nonmergeable (due to the 
previous duality results), but is not branch-trim. This tells us that both trellises are reducible. As 
in the previous example, the reducibility of these trellises will be obvious from the dual trellis, but 
is not at all evident from the primal trellis. 

The example appeared first in |9l [8]. Fig. shows the product trellis obtained from the 
generators O HI O, 10010, 01 101 with the indicated circular spans. Its dual is shown in Fig. p[b). 




(a) (b) 
Figure 3: TPOC, state-trim, branch-trim, nonmergeable trellis and its dual 



Both trellises are TPOC; they are easily seen to be state-trim, and thus both are nonmergeable due to 
Theorem 4.4 The trellis in (a) is also branch-trim, but the dual trellis is not: the diagonal branches 
of the last constraint code are not on any valid trajectory, and deleting them does not change the code 
generated by that trellis. This provides us with a 1-reduction where we replace the 3-dimensional 
constraint code C4 = (00|1|01, 10|1|10, 11|1|11) by the subspace C4 = (10|1|10, 11|1|11). It results in 
the trellis in Fig.Qb). By duality, the trellis in Fig.[3][^a) must also be 1-reducible. The dual process 
consists of replacing = (10|0|10, 11|1|01) by the supercode = (10|0|10, 11|1|01, 01|0|01). This 
results in the trellis in Fig. |4]^a), which then is the dual of that in Fig. |4](b). 

Evidently, the trellis in Fig. Qa) is unobservable and by duality (or by Theorem A.l) the trellis 
in Fig. Qb) is uncontrollable. Thus, we may apply the procedure from Remark 4.3 and trim the 
first trellis in a suitable way. We pick time 4 and trim to the subspace {00, 11}; dually, we merge 
the dual state space to F2/{00, 11}. This results in the mutually dual trellises shown in Fig. 5p " 



■^Observe that we could also have trimmed the state space 54 to {00, 10} or the state space So suitably. Evidently 
these various options could lead to different results; for another one, see [T] Ex. 4]. 
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(a) (b) 
Figure 5: State-trimmed trellis and state- merged dual trellis 

These trellises still generate the original code C = (OHIO, 10010, 01101) and its dual C"*", respec- 
tively. They form strict and conservative 2-reductions of the trellises in Fig. |3] because no state 
space has changed except ^4, which is smaller, and only the constraint codes at times 3 and 4 have 
changed, and none is larger. □ 



Summarizing, we observe that the trellis in Fig. [3](a) is strictly 2-reducible, even though it is 
TPOC, state-trim, branch-trim, and nonmergeable. We first had to perform an auxiliary branch- 
addition (a non-conservative 1-reduction) before a state-trimming resulted in a strict and conserva- 
tive 2-reduction. In the next sections we will derive the appropriate concepts for a systematic study 
of these phenomena. 

It is also worth noting that even though the trellises in Fig. [l|a) and Fig. |3|^a) are both product 
trellises, their duals are not - simply because they are not branch-trim, a property all product 
trellises share. In Theorem 5.6 we will give an intrinsic characterization of those product trellises 
that have a product trellis dual. 



5 Trellis Fragments and Global Trellis Properties 

In this section we study trellis fragments and show the duality of controllability and observability 
of such fragments. This will allow us to present some relations between various trellis properties, 
which then in turn leads to a characterization of when the dual of a product trellis is a product 
trellis. 

Let 7^ be a trellis of length m, and thus with symbol spaces Ai, state spaces Si, and constraint 
codes Ci Si X Ai X Si+i, all with index sets equal to Z^. 

Recall from Section [2] the definition of trellis fragments Ti\^'^\ where is any subinterval 

of "Lrn- In particular, the fragment T^b+^'-j) is defined as the edge Sj, i.e., it consists of two external 
state variables, denoted by Sj+m and Sj, with a common alphabet Sj and an equality constraint 
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C= = {{sj+rn, Sj) I Sj+m = Sj} between them. This fragment contains no symbol spaces or internal 
state spaces. 

The complementary fragment to 7^b+™j) is the fragment 7^ which consists of TZ with 
the edge Sj cut out. It contains all constraint codes and symbol spaces of TZ and has internal state 
spaces Si, where i £ + m), and two external state variables, with values Sj S Sj and Sj+m S Sj. 

The internal behavior 'B'-'''^^ of a fragment TZ^'^^ is the set of all trajectories (a^-^''^), sl-''^]) G 
A^'''^ X S^''''^ := rijeljfe)-^* ^ riielifc]'^*' ^^^^ satisfy all constraints, hence (si,ai,Sj+i) G Ci for all 
i £ [j^k). Such trajectories will be called valid [j,k)-paths, or simply valid paths. The external 
behavior C'-''^^ is the projection of ^^'^') on A^^'^^ x Sj x Sk- A fragment TZ^'^^ is thus a normal 
reahzation of its external behavior C^^^^\ Note that ^H+^'^'i) = C^i+">-d) = Q^^ whereas 55^'^+") is 
the set of all valid [j, j + m)-paths of TZ. 

We will say that a valid [j, A:)-path (a[-'''^\ s^-'''^]) G lies on a valid trajectory if there exists 

some valid trajectory (a, s) G whose projection on A^^'^'^ X 5^'^! is (ab'^), st-''^]). In particular, a 
valid [j, j+m)-path lies on a valid trajectory if and only if Sj = Sj+m- Notice that a traditional trellis 
diagram of a tail-biting trellis TZ of length m, such as any trellis diagram in this paper, actually 
illustrates the fragment TZ^^''^\ and the reader has to identify Sm with Sq. The behavior 55 1'^'"^-' is 
not in general the same as because, again, the latter consists only of the valid [0, m)-paths for 
which So = Sm- 

All trellis fragments are cycle-free. It follows from \T, Thm. 3] that a cycle-free fragment is a 
minimal realization of its external behavior if and only if all of its constraint codes are trim and 
proper. 

The dual fragment (TZ°)^'^^ is the dual normal realization to 'R}-^'^\ where the external state 
spaces (whose degree is one) are taken as symbol spaces. Thus (7^°)^''^) comprises the dual constraint 
codes {Ci)^,i G [j, fc), the dual symbol spaces Ai,i £ [j, /c), the internal dual state spaces Si,i £ 
(j, k), and the external dual state spaces Sj and S^. In the dual realization {TZ°)^^'^\ we recall that 
a sign inversion is applied to the value of Sk in C^_x' *o value of Sk in C^. Consequently, 

a sign inversion is applied to one of the two occurrences of each internal state space Si, i £ {j, k), 
and to the one occurrence of Sk , but not to the one occurrence of Sj . 

The internal behavior (53° )[-'''^') C ^b'^) x S^^'''^ of {TZ°)^^'''^ consists of ah valid [j, A:)-paths 
(a[i>fc)^s[-'''=l), i.e., (s^, Oj, -Sj+i) G (Cj)"^ for all i G [j,k). Its external behavior (C°)[^''=) C Sj x 
it^''^) xSk is the set of ah {sj,a.^^'^\ -Sk) such that (ab''^), Sfc) G {i'^")^^'''^) \M^,k)^SjxS,- normal 
realization duality, the external behavior of the dual fragment [TZ°)^'''^ satisfies (C°)[-''^^ = {C^'''^)-^. 

For example, for the fragment 7^b+''"J), representing the single edge 5^ and with behavior 
«g[i+"T-,i) _ Q[j+m,j) _ |.j^-g j.gg_(|g a,s follows. Note that the dual code to C= is the sign inversion 
constraint code Cr^ = {(sj+m,Sj) G Sj x Sj \ Sj^m = —Sj}. Thus, the dual fragment (7^°)[.J+™'J') 
has behavior (5S°)y+™-'j) = {(sj+m, Sj) \ (sj+m, — %) ^ C^} = {{sj+m, Sj) \ Sj+m = Sj}, which is the 
equality constraint on Sj. In other words, the dual fragment to an edge corresponding to Sj is an 
edge corresponding to Sj. The external behavior is (0°)^^'"^'^^ = C^, the sign inversion constraint. 

For any interval [j, k), we define the transition space r[^» of the fra gment 7^y•^) as the projec- 
tion C^^'^\s-y.Sk^ unobservable transition space lA^^'^'^ as the cross-section C^^'^^ -.SjxSki hence 
H\j,k) = {{sj,Sk) G Sj X Sk I (0,Sj,Sfc) G Cl-''^)}. Thus T't-''^) consists of all state pairs {sj,Sk) 
such that there exists a valid [j, /c)-path (a.^'''^ SjjS^^'''^ Sk), while U^'''^ consists of all such pairs for 
which there is a valid [j, A;)-path with a^'''^ = O^-'''^^. If the fragment lacks symbol spaces, as with 
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the edge fragment 7^b+'"'-?), then the cross-section equals the projection, i.e., Li^^'^'^ = T^^'^\ 

We note immediately that if C^^'^^ is trim and proper (i.e., C^^'^\si, = St and C^'^'^-.s^ = {0} for 
i = j, k), then T^^'^^ is trim and U^^'^^ is proper. 

A trellis TZ will be called [j,k)- controllable if T^^'^^ = Sj x 5^, and [j,k)- observable lilA^^'^^ = 
{(0,0)}. When [j^k) is a subinterval of the conventional discrete time axis Z, these definitions 
correspond to classical notions of controllability and observability in linear system theory. 

For a dual fragment {JZ°)^^'^\ we similarly define its transition spaces as the set of all state pairs 
in SjxSk for which there exists a valid [j, A:)-path, and where in addition, for the unobservable transi- 
tion space, the symbol sequence a^-'''') is Precisely, the transition space is defined as (r°)[^''=) = 
{{sj,sk) eSjxSk\3 (ab»,%,s(j'^),sfc) E (5S°)b»} = {{sj,Sk) \ (%,-4) G i{n^''^^)\s,>csj^ ^nd 
the unobservable transition space is {U°)^^'^^ = {{sj,Sk) \ {sj,—Sk) G -s xSt^' 

A dual trellis 7^° is [j , k)- controllable if {T°)^^'''^ = Sj x Sk, and [j, k)- observable if (Z^°)[J''=) = 
{(0,0)}. As a consequence, we have, just as for TZ, that TZ° is [j, /c)-controllable if {{C")^-''''^)^^,^^^ = 

Sj X Sk, and [j, fc)-observable if ((C")'-'''^-*).^,^^^ = {(0,0)}, since the sign inversion is evidently 
immaterial. Now we obtain 

Theorem 5.1 IfTZ and TZ° are dual trellises, then {{sj,Sk) \ (%,-Sfc) G (T")'^''')} = (^^1^''=))-^. In 
particular, TZ is [j, k)-observable if and only if its dual TZ° is [j, k) -controllable. 

Proof: By (C°)^^''''> = {C^'''^)-^ and projection/cross-section duality ( [2?T| ), we have {iC°)^^'''^)\s xSk ^ 
((j[i,fc).^^^^^)-L = ^^[j,k)-^^^ definition of (T'")^''^) yields the desired orthogonality. The sec- 

ond statement follows from {(0, 0)}"*" = Sj x Sk- □ 

We note that TZ is [j + m, j)-observable if and only if Sj = {0}. Since Sj = {0} if and only 
if Sj = {0}, Theorem |5 . 1 1 shows that TZ is also \j + m, j)-controllable if and only if 5^ = {0}. 

It is worth stressing that all statements pertaining to valid [j, A;)-paths, [j, fe)-controllability 
and [j, fc)-observability are equally valid for the primal trellis TZ and its dual TZ° . The only slight 
asymmetry, due to sign inversion, is contained in the external behavior (and thus in the transition 
spaces), and has been dealt with in the previous result. From this point on, no distinction needs to 
be made between a primal and a dual trellis. 

We next discuss various global notions of trimness. A trellis TZ will be called [j, k)-trim if every 
valid [j, A;)-path {s^i'^) ^s^^'^^) lies on a valid trajectory (a, s) G !B. Evidently TZ is [j, A;)-trim if and 
only if all state pairs {sj,Sk) in the transition space T^^'^^ also occur in T'''^'-'-'; i.e., T^^'^^ ^ 
Thus if TZ is [fc, j)-controllable, so T^^'i^ = Sj x Sk, then TZ is [j, A;)-trim. However, the converse is 
not true unless we require also that TZ be controllable. 

Theorem 5.2 (a) A [k, j) -controllable trellis is [j,k)-trini. 
(b) A controllable and [j,k)-trim trellis is [k, j) -controllable. 

Proof: We have already shown (a). To prove (b), we use t he d ual trellis TZ° . As we have seen above. 



[j, A;)-trimness of TZ implies r^^'^) C rt^j). By Theorem 5.1 this yields (W°)['''J) C (ZY°)b''=). But 



this means that for every {sj, Sk) G (14°)^'''^^ there is a valid trajectory in with a = 0. S ince TZ° 
is observable, (U°)^^'^^ must be trivial; i.e., TZ° must be [fc, j)-observable. By Theorem 5.1 TZ must 



be [/c, j)-controllable. □ 
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We now introduce notions of controller and observer memory similar to those of classical linear 
system theory. For 1 < t < m, we will say that TZ is t- controllable (resp. t-observable) if TZ is 
[j,j + t)-controllable (resp. [j,j + t)-observable) for all length-t intervals [j,j + t). 

In particular, a trellis TZ is m-controllable if and only if for all j there is a valid [j, j + m)-path of 
length m from any state sj £ Sj to any state Sj+m G <Sj- Thus m-controllable trellises are not only 
trim, but also state-trim. Dually, m-observable trellises are proper. Moreover, m-observable trellises 
are evidently observable, which implies that m-controllable trellises are controllable. However, the 
converses of these statements are not necessarily true, as we now proceed to show. 

We first note that a trellis is state-trim at Sj if and only if every valid [j+m, j)-path (sj^m, sj) € 
on a valid trajectory in *B. Then we obtain the following corollary: 

Corollary 5.3 A controUahle trellis is m-controUahle if and only if it is state-trim. Dually, an 
observable trellis TZ is m-observable if and only if its dual TZ° is state-trim. Consequently, a non- 
mergeable observable trellis is m-observable. 



Proof: By Theorem 5.2, a controllable trellis TZ is + m)-controllable for all j if and only if it 



is [j + m, j)-trim for all j, which is to say if it is state-trim at Sj for all j. The second statement 



follows from Theorem 5.1 The last statement follows from Theorem 4.4, which shows that if TZ is 



non-mergeable, then TZ° must be state-trim. □ 

For example. Fig. [l]^a) shows an observable trellis that is not m-observable (note the all-zero 
path between states S2 = 01 and S2 = 10); its dual in Fig. [l]^b) is a controllable trellis that is not 
m-controllable, and not state-trim at ^2. 



The last observation of Corollary 5.3 also appears in Thm. 7.8], where an m-observable trellis 
is called "totally one-to-one." 

Similarly, we note that a trellis is branch-trim at constraint code Cj if and only if every valid 
[i, i-|-l)-path (sj, Oj, Sj+i) G Cj lies on a valid trajectory in !B. Thus we obtain the following corollary: 

Corollary 5.4 A controllable trellis is (m — 1) -controllable if and only if it is branch-trim. Dually, 
an observable trellis TZ is (m — 1) -observable if and only if its dual TZ° is branch-trim. 



Proof: By Theorem 5.2, a controllable trellis 7^ is [i + 1, z)-controllable for all i if and only if it 
is + l)-trim for all i, which is to say if it is branch-trim at Cj for all i. The second statement 
follows from Theorem |5JJ □ 



For example, Fig.jsj^a) shows an observable trellis that is not (m— l)-observable (note the all-zero 
path between states S5 = 01 and S4 = 01); its dual in Fig. [sj^b) is a controllable trellis that is not 
(m— l)-controllable, and not branch-trim at C4. 

We remark that in the first statement of Corollary 5.4, controllability is necessary; for example, 
Figs.[2]^b) andQb) show uncontrollable trellises that are branch-trim, but not t-controllable for any 
t <m. 

Combining these corollaries, we obtain the following results. Part (b) can also be found in [3l 
Thm. 7.8]. 

Corollary 5.5 (a) An (m — l) -controllable trellis is branch-trim, state-trim and trim, 
(b) A controllable m-observable trellis is nonmergeable and proper. 
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Proof: (a) If 7^ is (m— l)-controllable, then it is also m-controUable, so it is not only branch-trim 



by Corollary 5.4, but also state-trim by Corollary 5.3, and thus trim, (b) If TZ is m-observable, then 



its dual Tl° is m-controllable, and thus state-trim by Corollary |5.3[ Theorem 4.4 implies that IZ is 



nonmergeable, which in turn implies properness. □ 

Controllability is necessary in (b) because an uncontrollable trellis is mergeable; for example, 
the trellis of Fig. is 3-observable but uncontrollable, hence mergeable. 

Finally, we address the question of when the dual of a product trellis is a product trellis. 
Koetter and Vardy [10] showed that a trellis is a product trellis if and only if it is "reduced" (state- 
trim and branch-trim), which gave them a powerful tool in their search for minimal trellises |13j . 
But Examples |4.5| and |4.6| show that the dual of a product trellis is not necessarily reduced. For 



observable product trellises. Corollaries 5.4 and 5.5 give us a nice characterization of when the dual 
is a product trellis. 

Theorem 5.6 (a) IfTZ is an (m — l) -observable trellis, then its dual TZ° is a product trellis, 
(b) IfTZ is observable but not (m—l) -observable, then its dual TZ° is not a product trellis. 



Proof: (a) If TZ is (m— l)-observable, then TZ° is (m— l)-controllable, thus reduced by Corollary 5.5 



thus a product trellis, (b) If TZ is observable but not (m— l)-observable, then TZ° is controllable but 



not (m — l)-controllable, thus not branch-trim by Corollary 5.4 thus not a product trellis. □ 



For example, the observable trellis of Fig. [T](a) is not t-observable for any t < m; its dual 
in Fig. [l]^b) is neither state-trim nor branch-trim. For another example, the observable trellis of 
Fig. [3][a) is m-observable but not (m—l) -observable; its dual in Fig. [3][^b) is not branch-trim. 

We remark that Theorem |5.6|^b) may be extended to unobservable proper trellises as follows. 



(By Theorem 3.1, the dual of an improper trellis is not trim, hence not reduced.) We have to 
redefine [j, A;)-observability as follows. Given a trellis TZ with behavior *B, the unobservable state 
configuration space is defined as 5" = 55:5 = {s S 5 : (0,s) E 53} [7j. Then TZ is called \j,k)- 
observable if the unobservable transition space Z^l-^''^) equals the projection (5")|5^x5fe; i-e-i if ^ does 
not contain any valid [j, fe)-paths with a'-'''^) = 0^-'''^^ other than those that lie on valid unobservable 
trajectories (0,s) G 55. Then we can show that if TZ is proper but not (m — l)-observable in this 
sense, then TZ° is not a product trellis. 



6 Constructing Reductions 

This section begins to establish the main results of this paper concerning whether a trellis TZ is 
[fc, j)-reducible. First, we shall give sufficient conditions for the [A;, j)-irreducibility of 7^, i.e., for TZ 
not having any [fc, j)-reduction other than itself, up to isomorphism. Second, when these conditions 
are not met, but another auxiliary condition is met, we will construct a strict and conservative 
[/c, j)-reduction. 



Due to Theorem 4.1 we may assume without loss of generality that TZ is TPOC. 



Theorem 6.1 Let j ^ k mod m. Suppose that both TZ and TZ° are TPOC and [j,k) -observable. 
Then both TZ and TZ° are [k, j)-irreducible. 
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Proof: It suffices to consider TZ. Let TZ he a [A:, j)-reduction of TZ. Without loss of generality 
we may assume that TZ is trim and proper at time k + 1, . . . , j — 1 since otherwise we may reduce 
further. We must show that TZ and TZ are isomorphic. 

Since 'R\^'^'^ = TZ^^'^\ the trellis TZ is [j, A:) -observable and thus observable. Furthermore, TZ is 



[j, A;)-controllable, and thus [A;,j)-trim by Theorem 5.2, Using trimness and [A;, j)-trimness of TZ, 
we conclude that TZ is state-trim at times k and j. But then TZ^'''') = TZ^^'^^ and [j, A;)-observability 
imply that TZ is also state-trim, thus trim, at times k and j. 

Thus it remains to show that the fragments TZ^^'^'^ and 'R}^'^^ are isomorphic. In order to do so 
we show first Cl'^'^) = Let (sfc, al'^'^), Sj) G Then there is a path (al*^-^), sl'^-j)) G ^Bt'^'^), 

and by [fc, j)-trimness this path lies on a trajectory in TZ, say (a, s) G *B. Observability of TZ implies 
that there is a unique trajectory (a, s) in the behavior % of TZ, and iz^'''^ = TZ^'''^ along with 
[j, A: ) -observability yields [slJ''^) ^s^^'''^) = (a^-'''^), sl-''^!). Hence {sj,Sk) = {sj, Sk), and this proves that 
(sfc,a[^'J'),Sj) G C^^'^\ In the same way one concludes that C^^'^^ C Cl'^'j). 

Ah of this shows that TZ^'''^^ and TZ^'''^^ are both trim and proper cycle-free trellis fragments that 
realize the same external behavior. By [3 Thm. 3] they are both minimal, and must be isomorphic. 
But then TZ and TZ are isomorphic, and this concludes the proof. □ 



We note in passing that Theorem 6.1 is also true in the case where j = k mod m, in which it 
reproduces earlier results. On the one hand, if TZ and TZ° are [j, j + m)-observable, hence [j, j + m)- 
controllable, then the proof of Corollary |5.3| implies that they are both state-trim at time j, and 
this may be regarded as [j + m, j)-irreducibility (recall the equality constraint C=). On the other 
hand, we have seen already that TZ and TZ° are [j -|- m, j) -observable if and only if Sj = {0}; in this 
case they are conventional TPOC trellises, hence minimal, and thus irreducible on any interval. 



Next, we recall that, as we have already seen in Example 4.6 and Corollary 5.4, a controllable 
trellis that is not (m — l)-controllable is not branch-trim, and thus has a conservative 1-reduction 
consisting of branch-trimming some constraint code, as in Fig. ^h). Dually, an observable trellis 
that is not (m — l)-observable has a non-conservative 1-reduction consisting of branch-expanding 
some constraint code, as in Fig. Qa). But this "reduced" trellis must be unobservable, and hence 
may be state-trimmed so as to make the reduction both strict and conservative, as in Fig. [5];a). We 
record these observations lemma: 

Lemma 6.2 If a trellis TZ of length m is observable but not (m—l)-observable, then it has a strict 
and conservative 2-reduction. Its dual is a strict and conservative 2-reduction ofTZ°. 



Proof: The dual trellis TZ° is controllable but not (m— l)-controllable, and thus by Corollary 5.4 is 
not branch-trim at some constraint code (Cj)"*". Replacing (Cj)"*" by a suitably branch-trimmed (Cj)"*" 
reduces the dimension of (Cj)-*" by one, without changing the realized code C"*". Dually, replacing Ci 
by Ci expands Ci by one dimension, without changing the realized code C. Denote the resulting 
realizations by TZ° and TZ, respectively. 



By Theorem 3.2 , TZ° must be uncontrollable, since we have reduced the dime nsion of a constraint 

we can trim TZ 



4.3 



code without changing 53 or 5. Hence TZ is unobservable. As shown in Remark 
at any state space without changing the code C. Trimming the state space Si reduces the dimensions 
of Ci-i, Si, and Ci by one, thus achieving a strict and conservative 2-reduction. By construction, 
the dual reduction is also strict and conservative. □ 



We now generalize Lemma 6.2 to trellises that are not (m — t)-observable, provided that the 
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trellis satisfies a certain technical condition. Without loss of generality, we may assume that the 
trellis is not [0, m— i)-observable. 



Theorem 6.3 Let 2 < t < m - 1. Let TZ be a TPOC trellis of length m that is not [0,m - t)- 
observahle; i.e., ^['^'™~*) is nontrivial, so (by properness) there is some sq / 0, Sm-t 7^ such that 
there is an unobservable path from sq to Sm-t in TZ^^'"^~^^ . Suppose TZ satisfies one of the following 
two conditions: 

Condition A: In the fragment J^i^-'t^"^-'^) ^ there is no valid path from Sm-t to S Sm-i- 
Condition A' : In the fragment 7^[™^*+i'0)^ there is no valid path from G Sm-t+i to sq. 
Then TZ has a conservative t-reduction and a strict and conservative {t + l)-reduction. For each of 
these reductions the dual is a reduction of the same type of the dual trellis TZ° . 

The t-reduction stated in the theorem is the main step of the reduction process and leads 



immediately to the strict (t + l)-reduction. Both parts will be used in Theorem 7.4 

We give a sketch of the proof and outline the reduction procedure. The details are carried out 
in Appendix [B| 

Sketch of Proof: By assumption there exists an unobservable valid path from sq 7^ to Sm-t 7^ 
m 

^[o,m-t)^ However, since TZ is observable, there can be no unobservable valid path from Sm—^ 
to So in the complementary fragment T^t™"*'"). 

Step 1: We expand T^I"^"*-") so that it contains an unobservable path (o['"^*'°), s[™^*'°]) from Sm-t '■= 
Sm-t to So := So via a sequence of new states Sj ^ Si for i G (m — t, 0). The internal state spaces 
and the constraint codes of 7^[™-~*'*^) are expanded to 

5+ = Si® (sj) for i G (m - t, 0) and C+ = Cj ((sj, 0, Sj+i)) for i £ [m.-t, 0). 

It is straightforward to show that the internal behavior of the fragment 7^['"~*'0) consequently 
expands to (^["^--m^+ ^ rg[m-t,o) ^ (^i^Q[m-t,o) ^^[m-t,o]^^y 

By construction, the expanded trellis TZ~^ is unobservable and has a valid trajectory (0, s) that 
passes through so and Sm-t- It is straightforward to show that its behavior is 53^*" = *B © ((0,s)), 
so it continues to realize the same code. 

Step 2: Assume that TZ satisfies Condition A. Then this guarantees (see Appendix pj) that we can 



find a strict subspace Sm-i C 5^„i such that there is no valid path from Sm-t to any state in Sm-i- 
We trim S^_i to 5m- 1- 

Step 3: By Condition A, the resulting trellis will not be trim at times m — 2, m — 3, . . . , m — t, 
and so one can successively trim the subspaces S^_2, . ■ ■ , Sm~t by at least one dimension. 

This will also reduce the adjacent constraint codes C^-n ^m-2i • • • ' ^m-t^ Cm-t-i by at least one 
dimension. All of this results in a strict and conservative [m — t — 1, 0)-reduction whose dual is 
of the same form. Trimming only the state spaces S^_2, ■ • . and the adjacent constraint 

codes C^_i, C^_2) • • • ) ^m-t results in the stated conservative t-reduction. □ 

We illustrate this procedure with an example. 
Example 4.6 The trellis of Fig. [sj^a) is TPOC but not [0, 3)-observable. It satisfies Condition A, 



in that there is no transition in C4 from 01 G cSs to 00 G ^4. Figure [6] illustrates the initial expansion 
of 54 to S^ = (1, s) and the corresponding expansion of the adjacent constraint codes, C3 and C4. 



16 



1 + i 




Figure 6: Expanding the trellis in Fig. 

Next, we identify ^4 = (1 + s) as a strict subspace of such that there is no valid path from 
01 G 53 to 54. Then is trimmed to ^4, as in Fig. ^ which also reduces and . 

1 + 5 




Figure 7: Trimming the trellis in Fig. [6] 

The resulting trellis is guaranteed not to be trim at 53, so ^3 and C2 may be trimmed to achieve a 
strict and conservative 3-reduction. Moreover, in this example, if we trim all states and branches 
that are not on any valid trajectories, then we reach the conventional (hence minimal) trellis shown 
in Fig. [8} 



10 01 10 l + s 10 




Figure 8: Trimming the trellis in Fig. [7] □ 

7 i-Irreducibility 

Now we are in a position to discuss t-irreducibility for all values of t not larger than a certain 
invariant of the code. We will see that it is characterized by (m — t) -observability and {m — t)- 
controllability. Thereafter we will illustrate the open problems that arise for larger values of t. Due 
to Theorem |4.1| we may restrict attention to TPOC trellises. 

We begin with 1-reductions, that is, the replacement of one constraint code. The following 
intrinsic characterization of 1-irreducibility shows in particular that every 1-reduction is either 
a branch-trimming (replacement of a constraint code by a strict subcode) or a branch-addition 
(replacement of a constraint code by a strict supercede). 
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Theorem 7.1 Let TZ he TPOC. Then the following are equivalent, 
(i) TZ and TZ° are 1-irreducible, 
(a) TZ and TZ° are branch-trim, 

(iii)TZ and TZ° are (m—1) -observable and {■m — l)-controllable. 

Furthermore, if TZ is 1-reducible, then it has a strict and conservative 2-reduction TZ whose dual TZ° 
is a strict and conservative 2-reduction of TZ° . 



Proof: (i) =^ (ii) is obvious, (ii) =^ (iii) follows from Corollary 5.4, and (iii) =^ (i) is a special case 
of Theorem |6.1[ For the last statement, let TZ be 1-reducible. Then either the trellis or its dual is 
(m— l)-unobservable and the result follows from Lemma 6.2 □ 



An example for the reduction of an (m — l)-unobservable trellis has been shown already in 



Example 4.6 



Recall that minimality of a trellis is defined on the basis of its state space dimensions. From 
the above we obtain the following corollary, which tells us that the constraint codes of a minimal 
trellis cannot be replaced by smaller (or larger) constraint codes. In particular, minimal trellises are 
branch-trim, which has also recently been established by different arguments in |3l Thm. 7.1]. One 
may recall that in [13j| Koetter/Vardy restrict themselves to state-trim and branch-trim trellises, so 
that in their terminology minimal trellises are branch-trim by definition. 

Corollary 7.2 A minimal trellis is 1-irreducible. 

We now consider i-irreducibility for t > 1. We first introduce the following parameter of a 
code C, which derives from the "characteristic spans" of Koetter/Vardy [I3j (see also [21 E]). 

Definition 7.3 The minimum span length x(C) of a code C A = Yl^ Ai is the minimum length 
of all possible spans of the nonzero codewords a G C, where a span of a 7^ is any interval, possibly 
circular, that covers the support of a. 

For example, the code C = {00000, 10110, 11001, 01111} C F| has minimum span length 
X{C) = 3. 

Now we can formulate the following characterization of t-irreducibility. The proof provides us 
with a constructive reduction method for f-reducible trellises. 

Theorem 7.4 Let min{x(C), x(C-^)} > t > 1 and let TZ be a TPOC trellis ofC. Then the following 
are equivalent. 

(i) TZ (and thus TZ°) is (m — t)-observable and {m — t) -controllable. 

(ii) TZ (and thus TZ°) is t-irreducible. 

For a t-reducible trellis TZ we have the following cases: 

ifTZ is (m — t + l)-unobservable or (m — t + l)-uncontrollable then TZ allows a strict and conservative 
t-reduction. If TZ is (m — t + l)-observable and [m — t + 1) -controllable, then TZ allows non-strict and 
conservative t-reduction which gives rise to a subsequent strict and conservative (t + l)-reduction. 
In either case, the dual process is a reduction of the same type for TZ° . 



Proof: (i) =^ (ii) is Theorem 6.1 As for the converse assume without loss of generality that T^P'"* *) 



is unobservable, and let sq and Sm-t be the end states of a nontrivial unobservable valid path of this 
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fragment. Since TZ is t-irreducible, Theorem 6.3 tells us that there must exist valid paths from Sm-t 
to G Sm-i in the fragment 7^["i-*,m-i) ^nd from G Sm-t+i to sq in 7^[»"-*+i.o) Adding those two 
paths (suitably appended by zero branches) results in a valid path from Sm-t to sq. But this means 
that the given unobservable path lies on a valid trajectory in TZ. Hence it represents a codeword 
in C that has a span of length at most t, and this contradicts our assumption. 



From Theorem 6.3 it is clear that every t-reducible trellis allows a non-strict conservative t- 
reduction that is non-trim and thus gives rise to a subsequent strict and conservative {t + 1)- 
reduction. Suppose now that TZ is (m — t + l)-unobservable. Hence there exists an unobservable 
valid path of length m — t -\- 1, say in 

^[o,m-t+i). With the aid of x(C) > t, we conclude that this 



path cannot lie on a valid trajectory, which in turn means that Condition A or A' of Theorem 6.3 
must be satisfied. Consequently, by that theorem there exists a conservative {t — l)-reduction and 
a strict and conservative f-reduction, whose duals are reductions of the same type. □ 



We remark that Theorem 7.4 applies to conventional trellises as follows. A trim and proper 
conventional trellis TZ and its dual TZ° are minimal and therefore t- irreducible for all t. Hence by 
Theorem 7.4, TZ and TZ° must be (m — t)-observable for all t < m.m{x{C),x{C'^)}- But this is 



obvious, since in a minimal conventional trellis an unobservable path of length m — t would imply a 
nonzero codeword with circular span length t or less, since all valid paths lie on valid trajectories. 



In this sense, the limit t < uim{x{C) , x{C )} in Theorem 7.4 is the best possible. 

Let us now return to the general situation. Theorem |7.4| characterizes t-irreducibility for small 
values of t. For t > min{x(C), xi^'^)} the implication (i) =^ (ii) remains valid (being solely based 



on Theorem 6.1), whereas the converse is not true in general. For instance, the trellis in Fig. [Tjis 



conventional and minimal, thus t-irreducible for each t, but it is not 2-observable. 

The next example illustrates that in some cases, t-reducibility for t > min{x(C), x(C"'")} may 



follow directly from Theorem 6.3 



Example 7.5 The trellis TZ in Fig. |9]is the product trellis obtained from the generators 11011 0000, 
010100000. 0000 1101 0, lOOOOOOn, OllOOOOOl, 11000 1101 with the indicated spans. The state labels 
are suppressed, and it suffices to keep in mind that the states at time zero appear in the same 
ordering at the beginning and end of the trellis. 



Figure 9: 2-irreducible and (m — 3)-unobservable trellis 

The code C C F2 generated by these vectors satisfies x{C) = 3 and x(C"'") = 6. One can see directly 
that the trellis is (m — 2)-observable, and it is also not hard to check that it is (m — 2)-controllable. 
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Thus, by Theorem 7.4 the trelhs is 2-irreducible. But the trelhs is (m — 3)-unobservable. Even 
more, the unobservable vaUd path in the fragment 7^^'^^ satisfies Condition A of Theorem 



6.3 



there is no vahd path from the ending state at time 6 to the zero state at time 8. As a consequence, 
the trehis is reducible on the interval [6,0). Performing the reduction procedure as in the proof of 



Theorem 6.3, we obtain the trellis shown in Figure 10 (where we added suitable state labels for 
further referencing). 




Figure 10: Step 1 of the reduction 



The (unique) subspace X of ^g*" as in Step 2 of the reduction process is X = (010, 111) C Sg . 
Trimming Sg to X leads to a trellis that is not trim at time 6 because there is no valid path 
from 11 E ^6 to any state in X. Thus, as stated in Steps 3 and 4, we can subsequently trim the 
state spaces and Sq. In this case, trimming to (010,111) and trimming Sq to (10) results 
in the trellis shown in Figure 11 This trellis, denoted by TZ, coincides with TZ on [0, 5) and is thus 




Figure 11: Steps 3 and 4 of the reduction leading to a strict 4- reduction 

a strict and conservative 4-reduction. The trellis is (m — 2)-observable and (m — 2)-controllable. 
Furthermore, it can easily be checked that TZ and TZ° do not contain any unobservable valid paths 



satisfying Conditions A or A' of Theorem 6.3, and thus we do not have any other reduction method 



at our disposal. This is not surprising because it can be shown (with the aid of the class of KV- 
trellises as introduced by Koetter and Vardy in [13]; see also Section [8|, that 7^ is a minimal trellis 
and every trellis for the same code with state spaces of at most the same sizes is isomorphic to TZ. 
Thus TZ is t- irreducible for every t. □ 



Example 7.6 The trellis in Fig. |l2[a) is the product trellis obtained from the generators 101100, 
00 1101 , 011011. Its dual is shown in (b). 
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(b) 



Figure 12: Dual pair of nonminimal trellises 



The code C generated by these vecto rs contains the word 100001 and thus satisfies x(C) 
whereas x{C'^] 



3. Hence Theorem 7.4 is not applicable. Furthermore, it is easy to see that the 



trellis and its dual do not contain any unobservable valid paths satisfying Condition A or A' from 



Theorem 6.3, and thus none of our reduction methods applies. Yet, in this case the trellises are 



reducible. Indeed, Fig. 13 shows mutually dual strict reductions on the interval [4,3). 





(b) 



Figure 13: Dual pair of (m — l)-reductions 



These trellises are conventional, and thus minimal and t-irreducible for every t. Note that 
the trellis in Fig. flsFa) is a conservative reduction of Fig. [T2|a), whereas the dual reduction is a 



non-conservative reduction of Fig. 12 b). 

The trellises in Fig. 13 can be obtained constructively from those in Fig. [12} applying twice 
and in a suitable way the reduction from the proof of Theorem 6.3 to Fig. 12 a) will result in 
Fig. |l3[a). Even though Theorem 6.3 does not apply, this will eventually lead to the reduction 



on the interval [4,3). With the aid of the class of KV-trellises, one can show that the trellis in 
Fig. [l3[a) is the only trellis for C that is strictly smaller than that in Fig. [l2[a). Therefore, it is 



also the only possible reduction. By duality, the same applies to the dual trellises in Fig. 13 b) 



and Fig. 12 ^b). Hence we conclude that there exist strictly t-reducible trellises that do not allow a 
conservative reduction. □ 



As the last two examples have illustrated, it remains an open problem how to characterize 
i-irreducibility for t > £ := min{x(C), x(C "*")}. By Theorem 6.1 we can expect i-reducibility only if 
there exists an unobservable fragment of length m—t in the trellis or its dual. If such an unobservable 



valid path satisfies Condition A or A' from Theorem 6.3, then the reduction procedure from the 
proof of this theorem is applicable and the trellis is reducible. As a consequence, the only remaining 
case is where the unobservable valid path does not satisfy either of the conditions. As shown in the 



proof of Theorem 7.4 this means that the path lies on a valid trajectory (which, for instance, is the 
case in any conventional trellis). Obviously, the support of the associated codeword is contained in 
an interval of length t. Summarizing, one needs to study unobservable valid paths of length < m — i 
that lie on valid trajectories. Supported by many examples, we formulate the following conjecture. 
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Conjecture 7.7 Any nonminimal trellis can be reduced constructively using a finite number of 
steps as in the reduction procedure from the proof of Theorem 6^ along with suitable state trim- 
mings applied to the trellis or its dual. 



8 Comparison to KV-Trellises 

In this section we relate our results to previous work on trellises and their complexity. To this end, 
we restrict ourselves to trellises with symbol spaces Ai = ¥ for all i and to codes C in F'" such that 
both C and C"*" have full support, that is, the codewords do not all vanish at a fixed coordinate; in 
other words, min{x{C),x{C'^)} > 1- 

Koetter and Vardy [I3j showed that the search for possibly minimal trellises can be narrowed 
to a certain canonical class, which we call KV-trellises. A KV-trellis is a product trellis based 
on dimC linearly independent generators with shortest spans that all start and end at different 
positions. A span [a, a + r] (in the circular sense) is called a shortest span of the code if r is the 



smallest length of the spans of all codewords (in the sense of Definition 7.3) that are nonzero at a; 
see also [HI [8] . KV-trellises may be regarded as the tail-biting version of the realizations resulting 
from the "shortest basis" approach in [6j. 

Being product trellises, KV-trellises are state-trim and branch-trim, and from the choice of the 
generators it follows that they are proper, observable and controllable. Moreover, in |13l Thm. 5.5] 
Koetter and Vardy have shown that each (reduced) minimal trellis is a KV-trellis. However, the 
converse is not true: not all KV-trellises are minimal. 

In [HI Thm. IV. 3] it is proven that the dual of a KV-trellis is a KV-trellis of the dual code. 



As a consequence. Theorem 5.6 implies that KV-trellises are (m — l)-observable and (m — 1)- 
controllable, and thus 1-irreducible due to Theorem |7.1[ With the machinery developed in jS] 
(more precisely, by a generalization of Theorem 11.13 in |8J), one can show that if a code C satisfies 
min{x(C), x(C"'")} > t, then all its KV-trellises (and their duals) are (m — t)-observable and hence 
t-irreducible by Theorem |7.4[ However, this property does not characterize KV-trellises. Indeed, the 
trellis in Fig. M (and its dual) is not a KV-trelli^ but 2-irreducible and represents a code satisfying 
min{x(C),x(C^)} = 3. 

Summarizing, for a given t and a code C such that mm{x{C),x{C^)} > t > 1 we have the 
following proper containments of trellis classes 

minimall C |kv1 C { J^^Jp^;^"^"''''} = { ^^^^oi;'''" £ {nTs.POC ^ C I T..POC 



I I L 



invariant under dualization not invariant under dualization 

where N stands for nonmergeable, Tgb for state- and branch-trim (as opposed to the weaker trim- 
ness), and, as before, P,0,C stand for proper, observable, and controllable, respectively. 

As indicated, the last two containments are strict as well: for instance, the trellis in Figure [T]^a) 
is in the rightmost class, but not in {NTgbPOC}; moreover, it is straightforward to verify that 
the product trelhs generated by 0010100, 0001011, 1000100, 0110001 reahzes a code C that satisfies 
min{x(C), x(C"'")} = 3 and is in {NTsbPOC}, but 2-reducible. 



The sum of the first four generators given in Example 7.5 results in a codeword with span [5, 8]. Since this span 



is shorter than the span [5, 1] of the last generator, the latter is not a shortest span of the code. 
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The three leftmost classes are invariant under taking duals. This is clear for minimal trellises 
and for i-irreducible trellises and follows from [51 Thm. IV. 3] for KV-trellises. Fig. [3] and Fig. [l] 
show that the two rightmost classes are not invariant under taking duals. 

9 Conclusion 

We have presented constructive procedures for reducing a given tail-biting trellis realization and 
its dual and have provided criteria for when a trellis is irreducible on an interval of length t. The 
criteria are sufficient for all codes, and necessary and sufficient for codes of minimum span length 
bigger than t. We have also discussed the remaining case of reducibility on intervals of length at 
least the minimum span length of the code. While we believe that all nonminimal trellises can be 
reduced, finding a constructive procedure remains a largely open problem. 

As a main tool of our approach, we have used trellis fragments, i.e., realizations obtained by 
cutting two edges in the normal graph of the tail-biting trellis. We have introduced the notions of 
fragment controllability and observability, which are, naturally, the same as those in classical linear 
systems theory, and have shown that they are mutually dual. 

With the aid of fragment trimness, which implies that every valid path in the fragment is the 
restriction of a valid trajectory in the entire trellis, we have presented criteria for state-trimness and 
branch-trimness of a tail-biting trellis. Using the well-known fact that a tail-biting trellis is a product 
trellis if and only if it is state-trim and branch-trim, our results have also led to a characterization 
of when the dual of a product trellis is a product trellis. 

Finally, we have discussed the relation of our results to the prior tail-biting trellis literature 
that relies on product representations. 

Beyond trellises, we believe that many of our results can be generalized to normal realizations 
on general graphs. 

A Controllability and Connectedness 

In this appendix we discuss the relationship between controllability of a trellis realization and 
connectedness of the trajectories in its trellis diagram. In [7, Thm. 10] it was shown that if a 
trellis is trim but not controllable, then its valid trajectories partition into disconnected subsets. 
Moreover, it was noted in [7j that, using the product representation of [13j, a state-trim and branch- 
trim trellis is uncontrollable if and only if its trajectories are disconnected. We will now show that 
this statement holds if the trellis is merely state-trim. 

Theorem A.l A state-trim trellis is controllable if and only if it is connected. 

Proof: The if-part has been proven (for trim trellises) in [71 Thm. 10]. For state-trim and branch- 
trim trellises a proof of the converse is sketched in [71 Sec. IV. F] by using the fact that every 
such trellis is a product realization of one-dimensional trellises. For non- branch-trim trellises a 
proof of the converse is as follows. Let 7^ be a controllable, state-trim trellis and suppose TZ is 
not connected. Consider the connected component of TZ containing the zero trajectory. Denote 
the state and constraint sets of this subtrellis by Si^ and Cifi, respectively. With the aid of state- 
trimness one easily verifies that Cj^o is a linear subspace of Ci for each i. Notice that Sift is the 
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union of the projections of Ci^ and Ci-ifl on Si. Again using state-trimness one can see that Sifl 
is a Hnear subspace of Si for ah i. Thus, the connected component forms a hnear subtrelhs TZq 
with state spaces Sifl and constraint codes Cj,o- Denote its behavior by QSq- Then the behavior 'B 
of TZ is the union of disconnected subbehaviors, where £ := dim*B — dim!Bo, and by Hnearity and 
state-trimness each state space Si and constraint code Ci of TZ is the union of cosets of Si^ and 
Cifi, respectively. Using controllabihty of TZ we obtain dim*Bo < dim 55 = ^j(dimCj — dim5j) = 
^^(dimCj^o — dim5j^o)) and this contradicts Theorem 



3.2 



for the trelhs TZ\ 



0- 



□ 



We wish to point out that state-trimness is indeed necessary for the only-if part to be true. 



The two hnear, non-state-trim trehises shown in Fig. 14 are disconnected, yet form controllable 
realizations of the code C = {00}. It is also worth observing that in the trellis in Fig. 14 ^b) the 
connected component containing the zero trajectory is not a linear subtrellis. 





(a) (b) 
Figure 14: Disconnected and controllable trellises 



Finally, we note that [TJ Sec. IV. G] shows that Theorem A.l does not generalize to normal 
linear realizations on general graphs with cycles. 



B Proof of Theorem 6.3 



Without loss of generality we assume that TZ satisfies Condition A. In a first step we expand the 
trellis TZ to an unobservable trellis by increasing the state spaces at times m — t + l,...,m — 1 by 
one dimension. Thus, pick new states Sj Si for i = m — t + 1, . . . ,m — 1. For ease of notation, 
define Sm-t '■= Sm-t, sq '■= sq, and expand the fragment T^t™-*'") via 

5+ =Sie {si) for i G (m - t, 0) and C+ = Ci® {{si, 0, Si+i)) for i£[m-t,0). (B.l) 

By construction, the expanded trellis TZ'^ has a nontrivial unobservable valid trajectory (0, s) that 
passes through the states Si, i S [m — t,0]. 

Using the fact that Si Si for i £ (m — t, 0), we obtain immediately for i € {m — t + l, . . . , m — 2} 

{vi + asi,ai,Vi+i + (3si+i) G C+ for some (wj, Oj, Wi+i) G Si x Ai x a,/3 G F =^ a = /3. (B.2) 

The trellis TZ~^ has the following properties. 

1) The behavior of TZ~^ is given by 55^ = *B © ((0, s)), and thus TZ~^ represents the same code C. 



To see this, consider a valid trajectory in 55^. Due to (B.2), the state sequence must be of the form 
{vq, ... , Vm-t, Vm-t+1 + oSm-t+i, • • • , Vm-1 + aSm-i,vo), where Vi G Si for all i. Subtracting the 
unobservable trajectory a(0, s) yields a valid trajectory that is entirely in the subtrellis TZ, hence it 
is an element of 
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2) There is no valid path from Sm-t S Sm-t to G ^^-i in the fragment (T^^)^"^ ^\ To 



show this, suppose we have such a path. By (B.2) its state sequence is of the form (sm-t, "Um-t+i + 



asm-t+i, ■ ■ ■ ,Vm-2 + O(Sm-2,0), where Vi G Si, and once more by (B.2) we conclude that a = 0. 
But then the given path is a valid path in 7^ "^-i)^ and this contradicts Condition A. 

3) There exists a subspace X of satisfying X © (sm-i) = ^^-i and such that there is no 

valid path in (7^+)[™-^,™-l) from 

Sm—t to any x G X . This can be seen as follows. Put 

y := {s £ <S^_-^ I there is a valid path from G Sm-t to s in the fragment (7e,+ )[™-*'™-i)}. 

Then Sm-i y because if there was a valid path from to Sm-i, then the existence of a path with 
state sequence {sm-t, Sm-t+i, Sm-t+2, ■ ■ ■ , Sm-i) leads to a valid path in (T^+y™-*'™--!) from Sm-t 
to G and this contradicts our observation in 2). Using again the path from Sm-t to Sm-i 

we observe that for each a G F the coset 3^ + asm-i is exactly the set of all states in S^_i that can 
be reached by a valid path from asm-t- Now, we may choose any subspace Z C such that 

Z®y® = and ^Mi X = Z®y. 

Having established these properties we can perform the reduction: 

a) Trim *° subspace Sm-i ■= X, where is as in 3). By Remark 



4.3 



this results in 



a trellis that still represents C. Denote its constraint code at time m — 2 by Cm-2- 

b) Let Sm-2 be the projection of Cm-2 on the state space 5^_2- Then Sm-2 is contained in the 
set {s G S^_2 I there is no Vctlid. path, from Srn—t 

to s}, and the latter is a proper subset of 5^_2- 
Thus, dim5m-2 < dim5^_2. Obviously, the states not in Sm-2 are not on any valid trajectory, 
and thus we may trim S^_2 to Sm-2- After this trimming denote the constraint code at time m — 3 
by Cm-3 and continue in the same manner. 

c) All this shows that we can trim all state spaces S^_2, ■ ■ ■ by one dimension. 



Since the branches that have been added in (B.l) will be trimmed, this also reduces the constraint 



codes Cj^, i = m — t, . . . , m — 1, by one dimension. Thus the resulting trellis, denoted by TZ, is an 
[m — t, 0)-reduction with the same state space and constraint code dimensions as TZ. Consequently, 
the same is tru6 for the dual reduction 7^*^^ of 7^*^^. Finally, by construction, Sm—i G Sm-t is not on 
any branch in the constraint code Cm-t, and thus TZ is not trim at time m — t. Trimming results in 
the desired strict and conservative [m — t — 1, 0)-reduction of TZ, whose dual is a reduction of 1Z° of 
the same type. □ 
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